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5 . Abstract 

1/^ ' This paper studies a class of source coding problems that combines elements of the CEO problem 

with the multiple description problem. In this setting, noisy versions of one remote source are observed 
by two nodes with encoders (which is similar to the CEO problem). However, it differs from the CEO 
^ ' problem in that each node must generate multiple descriptions of the source. This problem is of interest 

in multiple scenarios in efficient communication over networks. In this paper, an achievable region and 
►..^ , an outer bound are presented for this problem, which is shown to be sum rate optimal for a class of 

CO , distortion constraints. 

o 

I. Introduction 

O 

Q I Determining the theoretical limits of lossy compression schemes are of signiticant interest. Results 



X 



in lossy source coding have applications in multiple domains including multimedia communication & 
storage, image processing and distributed processing over sensor networks. A single representation for a 
single source is today a fairly well established field of research HI. When multiple representations and/or 
sources are involved, there are only a limited set of exact results known. The lossless compression of 
correlated sources, studied in m by Slepian and Wolf, is one of the early success stories in this domain. 
Subsequently, the Gaussian two-terminal multiple description (MD) rate region was characterized in 131. 
More recently, many new results have emerged in the field of Gaussian multiterminal source coding 
151 . In particular, the Gaussian CEO problem was studied in l6l and Q, where the sum rate and the 
entire rate region were characterized. lU provides a simplified converse argument for the sum rate. The 
rate region of the Gaussian two-encoder problem was characterized in 

We consider a version of the CEO problem in which the CEO can "vacation." The setup is described 
by Figure 1. We have a single source S, and two corrupted versions of the source Xi = S + Ni and 
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X2 = S + N2 are available at the two encoders in the system. The encoders wish to communicate 
information about S* to a decoder, i.e., the CEO, which they accomplish by each sending a data packet at 
time 1 and another at time 2. The CEO may be on vacation during time 1, time 2, neither, or both, and 
she cannot receive data packets when she is vacationing. We assume that the CEO's holiday schedule 
is unknown to the encoders. If the CEO works during time 1 and vacations during time 2, she expects 
to reproduce the source S to distortion Di. Likewise, if she works during time 2 and vacations during 
time 1, she expects to reproduce S to distortion D2- If the CEO eschews vacation and works during 
both periods, then she expects to reproduce S to distortion Dq. For convenience, we represent the three 
vacation states of the CEO by three separate receivers in Figure 1. Details on the system model and 
problem at hand are presented in Section |lll 

This problem generalizes both the CEO problem, by omitting the transmission at time 2, and the MD 
problem, by omitting the noises A'^i and N2. We note that a related problem is considered in ifTOl . which 
also generalizes both CEO and MD. However, unlike the other problem formulation, we are able to obtain 
a more conclusive sum rate result. The vacationing-CEO problem arises in multicast networks in which 
receivers enter and depart the systems at arbitrary times. See ifTTTl . |[T2l for additional discussion of this 
connection. 

The rest of this paper is organized as follows: In the next section, we state the problem and describe the 
main result of the paper, which characterizes the sum rate of the Gaussian problem with CEO vacations. 
In Section |llll we show that the sum rate described in Section |ll] is achievable, and in Section |lVl we 
provide a lower bound for the Gaussian vacationing-CEO problem. This lower bound combines converse 
techniques developed individually for the MD problem 131, |[T3l and the CEO problem 161, HI. In fact, 
it is interesting to note that our lower bound requires the use of both converse techniques for the CEO 
problem, as neither alone is sufficient. In Section |Vl we establish the equivalence of the achievable sum 
rate and the lower bound on it, thus proving the main result of the paper. 

A. Notation 

We use capital letters to denote random variables and £[5] to denote the expected value of a random 
variable S. All logarithms used in the paper are natural logarithms. \ai{S\T) denotes E5' r[(5'— E[S'|T])^]. 
For S = {81,82), Cov(5|r) denotes the matrix ¥.§^^[{3 - ^[S\T]){S - E[S|T])t], where is the 
transpose of the vector S. 
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Fig. 1. System Model 



II. Problem Statement and Main Result 

Let {Xii}^^^ and {X2i}^^i be noisy observations of an underlying Gaussian source {5^}"^^, observed 
by two different encoders. The observations and the source are assumed to be independent and identically 
distributed (i.i.d.) over i. For each time instant i, the observations are given by 

Xii = Si + Nii 

X2i = Si + N2i 

where Nu and N2i are Gaussian distributed with mean zero and variance cj|^^ and cr^^. Si has mean 
zero and variance Og. Encoder k observes {Xki}^^i for = 1,2 and sends two descriptions given by 
Cki = fkii^k)' for ^ = 1,2 to two receivers. Let R^i > ^log\Cki\- Receiver /, gets the messages 
fii{Xi) and /2i(X2 ), and applies decoding function ipf{fii(X^), f2i{X2)) to obtain an estimate of the 
source S^ , denoted by SJ^.The central receiver gets all the four descriptions and applies the function 
99^(/ii(Xf ), f2i{X^), fi2{X^),f22{X^)) to get S^. We say that the tuple {Rii,Ri2, R2i,R22, Di,D2, Dq) 
is achievable if there exist encoding and decoding functions such that 

Di > ^^mSi - Sh)% /g{0,1,2}. 

i=l 
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We now state the main result of the paper. Let 

U = {(C/ii, Ui2, U21, U22) : Uki = Xk + Wki for k, I G {1, 2}, Wti ~ A/'(0, a^^J, 

{Ull,Ul2)-Xi-X2-{U2l,U22), 

E[(5 - E[S|C/i/, U2i]f] < Di for / € {1, 2} and 
E[(5 - E[S\Un, f/12, ^721, t/22])'] < Dq}. 
Theorem 1. The sum rate of the vacationing-CEO problem with distortion constraints {Di, D2, Dq) such 

inf /(Xi, X2; f/11, C/12, ^721, t/22) + I{Uu,U2i; U12, U22). 

(C/ll,C/l2,!721,[/22)GW 

The technical condition on the distortions implies that the distortion constraint at the central receiver 

satisfies maxlT^-, 7^|<7V<7^ + 7^ max|^— , ^— | — V- This means that the central distortion 

constraint is comparable with (although lesser than) the distortion constraints at the individual receivers. 
Note that the sum rate achieved here is a more general version of the achievable sum rate of the CEO 
problem with two sensors and the MD problem with two descriptions. In effect, the vacationing-CEO 
problem with just one sensor and encoder (or R21 = and R22 = 0) is a remote source version of 
the two description problem. In the absence of the central receiver (or Dq > the vacationing-CEO 
problem reduces to two CEO problems corresponding to Receivers 1 and 2. We discuss the achievability 
in the following section. 

III. Achievability 

The achievable scheme discussed below is a Gaussian scheme. We define auxiliaries, Uii,Ui2,U2i and 
U22 such that 



Uii 


= Xi 


+ WII 


Ul2 


= Xi 


+ W12 


U21 


= X2 


+ W21 


U22 


= X2 


+ W22 
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K, 








where the vector W = (M^n, VF12, VF21, W22) is Gaussian distributed with mean zero and covariance 
matrbc 

U fJ^^^ -02 

-02 0-^^^ 

'Kw is appropriately chosen to meet the distortion constraints at Receivers 1 and 2 and the central receiver. 
In effect K,„ is chosen such that 



-ai 
^2 



E 



{S -¥.[S\UiuU2i]f <A,Zg{1,2} 



(5-E[5|C/ii,C/i2,C/21,C/22])' 



A. Codebook Generation 

Encoder k, k = 1,2, generates 2"^" UJ!^ and 2"^'''2 such that t/^ij and Uk2i are generated i.i.d. 
according to the marginal of Uki and Uk2 respectively. 2"^" [/^^ and 2"^'''2 are binned into 2"^'=i 
and 2"^''^ bins respectively. 



B. Encoding 

Encoder k chooses the pair {UJ^i, U]^2) jointly typical with XJ} and transmits the respective bin indexes. 
There exists a pair {UJ}-^^, U'^2) jointly typical with X"^ with high probability if 

R'k^>I{Xk;Uki) 

R'k2> I{Xk;Uk2) (1) 

R'ki + K2 > liXk] Uki, Uk2) + /(C/fci; Uk2). 

This multiple description encoding scheme is similar to the scheme in |[T4l . Since (C^f|,f/f2) ~ ~ 
X^ - U^^), by the Markov lemma (Lemma 14.8.1) in HI, we also have that (;7[\, U^^, U^^, U^^) 
are jointly typical. 

C. Decoding at individual receivers 

Receiver I, I = 1,2, looks for and U^i that are jointly typical in the bins corresponding to the bin 
indexes it receives. Receiver / will be able to find unique codewords f7[; and that are jointly typical 
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if 



Rn> R[i-IiUn;U2i) 



R2i> R'2i-I{Uii;U2i) 



(2) 



Rii + R21 > R'li + R21 - U2i)- 



Receiver I generates an estimate of 5", by constructing the minimum mean squared estimate (MMSE) 
E[S'"|C/{), C/^J. The decoding scheme resembles the decoding in the Berger-Tung scheme |[T5l . 

D. Decoding at central receiver 

Receiver mimics the decoding at Receiver 1 and 2 to find jointly typical pairs {Uii,U2i) and 
(C/"2) ^22) i'^ ^^'^ received bin indexes. Therefore, Receiver will be able to find such unique codewords 
if the rates satisfy Q. Since C/{2, f^g^, 6^22) jointly typical, Receiver constructs the MMSE 
estimate of 5" given by E[S"j[/{\, f/fg, U^i,UI]:2]. 

Note that the equations in ([T|) and Q represent the entire rate region achievable by the Gaussian 
scheme for the vacationing-CEO problem. We now consider the sum rate achievable by the Gaussian 
scheme. 

Lemma 1. The sum rate achievable by the Gaussian scheme is given by 



The lemma is proved in Appendix [A] We present the lower bound on the sum rate in the next section. 

IV. Lower Bound 

We now make a few definitions before presenting the lower bound on the sum rate. Cki denotes the 
code from Encoder k to Receiver / for /c = 1, 2 and I = 1,2. 
Define, 



inf 

(i7ii,r/i2,r/2i,r/22)ew 



/(Xi,X2; Uii,Ui2, U2U U22) + I{Uii, U21; U12, U22). 



(3) 





i=l 



i=l 





(4) 



i=l 



i=l 



ti — —I{Xi;Cii,Ci2\S^) 



h — —I{X2',C21,C22\S"'). 
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We remark that in the following < Dq < m.m{Di, D2} and may:{Di, D2} < cr|. We now define for 
k = l,2, 

J^k = {idi,d2,t) : di,d2,t G [0, 00) 

cT^^e"^* - min{di,(i2} max{(ii, ^2} < ^^N^}- 

Further define, 

= {{dn,di2,d2i,d22,ti,t2) : {dki,dk2,tk) S /fc, A; = 1,2 

J_<^^ J__dn_^ (5) 

2^2^2 4 4 ^ 

Di ai. aj^^ af^^ a%,^ 
1,1,1,1 di2 d22 

1 ^ 1 l-e-2*i l-e-2*^. 

We have the following lemma which characterizes the parameters p = ((^11,^12,(^215^22,^1,^2) defined 
above. 

Lemma 2. The parameters defined in (0) satisfy p ^ T. 
Proof: The proof that 



1 1 1 - e-^*i 1 - e 
^ < ^ + o + 



2*2 



^0 ol g\ 

follows directly from Lemma 3.1 in fT]. Also, in Theorem 1 in lH, it is shown that 



111 \ dxi d2i 

"FT — 2 ^ 2 ' 2 4 4 

ct| cj^^ cj^^ cj^^ cj]^^ 



for Z = 1, 2. By definition, 

nth = -^(-'^fc, Cfci, Cfc2|<S'") = /i(X^|S'") - /i(X^|Cfci, Cfc2, 5'" 



> ^loga^,^ -MX^|Cfcz,5"),/ = l,2 



Therefore for A; = 1, 2, 

c^Ar.e"^*'" < min{4i,42}- 
Also, since E[A^^|Cjfc;] achieves a smaller mean squared error in than any other estimator. 



^ n 1 " 

4i = - VVar(Xfci|Cfc;,5") = - VVar(iVfcijCM) < 



n — ' n — ' 

i=l i=l 
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for = 1, 2 and I = 1,2. This concludes the proof of the lemma. ■ 
Define, 

= {{du,di2,d2i,d22,ti,t2) : (dii, (ii2, (^21, c?22, ^i, ^2) e T 
Di ai. 

7-1 2^2^2 4 4 ^ -' 

D2 a^s '^k '^k "^k 

1 1 1-6-2*1 
TT = — + 2 + 2 } (10) 

^2 = {{du,di2,d21,d22,h,t2) ■■ {dll,di2,d21,d22,ti,t2) G T 

^^^ l l_dn_d2^ 

7~i 2~'~2~'~2 4 4 

1 11 1 di2 d22 



n 2~^2~^2 4 4 

^2 CT^^ 



1 1 1 - e-2*i 1 - e-2*2 

< ^ + o + 



We denote 



o-|r^e-2*^ = min{(iii,(ii2} crAr^e"^*' = min{(i2i, ^22}}- 
77 = T'l U7'2. 



Note that the definition of V imposes the restriction on the parameters to satisfy the individual distortion 
constraints with equality. The central distortion constraint may be satisfied with equality or the parameters 
satisfy cr^^e-^** = m.m{dki,dk2} for k = 1,2. We also observe that V <Z T. 
Let p ^ T. Then A J'p is defined as 

AT'p = {Ap= (Adii, Adi2, A(i2i,Ad22,-Aii,-At2) : Adn, Adi2, Ad2i, A(i22, Ati, At2 e [0,oo) and 
{dii + Adii, (ii2 + Adi2,d2i + A(i2i, (^22 + A(i22, ti - Ati, t2 - Ata) G T'}. 

Lemma 3. ATp / Vp € J". 

Proof: The lemma is proved as follows. Consider p £ T. Then we increase dn and (ii2 by Adu and 
Afii2 until we meet the distortion constraints at individual receivers with equality or du + Adu = aj^^, 
/ = 1,2. In the former case, we satisfy the individual distortion constraints with equality. In the latter 
case, we now increase ^21 and ^22 by Ad2i and Ad22 until we meet the individual distortion constraints 
with equality. We will be able to find such Ad2i and Ad22 satisfying ^2/ + Ad2« < (^%^, I = 1,2, since 

January 5, 2010 DRAFT 



Di < (t| for I = 1,2. Now, we decrease ti by Ati until the central distortion constraint is met with 
equality or cr^^e~^^*^~'^*^^ = minjciii + A(iii,(ii2 + Adu}- In the former case, we satisfy the central 
distortion with equality. In the latter case, we decrease t2 by At2 until the central distortion constraint is 
met with equaUty or cj^^e"^^*""^*") = min{d2i + A(i2i, ^22 + Ad22}- Therefore \fp G T, ATp ^ (p. M 
Let = 1, 2 and (t| > 0. Define, for {di, d2,t) € T^, 

rfc(di,d2,t,4) = t + llog :'^2%|/!_ 2 ^ + ^ ^ogial^e-^' + (11) 
2 (di + fT|)(d2 + 2 

We now state the main result of this section. 

Lemma 4. The sum rate of the vacationing-CEO problem is lower bounded by 

1 fj^ 

inf sup ri{dii,di2,ti,al ) +r2{d2i,d22,t2,crlj + -logyr-j—. (12) 
Proof: By procedural steps, we have 
n(i?ii + R21 + i?i2 + ^22) >H{CiuC2i) + //(Ci2, C22) 

>if(Cii, C21) + H{Ci2, C22) — -f^CC*!!, C21, C12, C22) 

+ H{Cu,C21,Ci2, C22) — H{Cii,C2l,Ci2, C22\Xi , X2) 

=I{Xi , X2; Cii, C21, C12, C22) + I{Cu, C21; Ci2, C22) 

i^) J f on, r~i r~i /-y ^ i r/ vn \rn, \ oti\ 

— 1\P , Oil, O2I, (-^12, ^-22; + -< l-^l , -^2 ) ^11; ^21, tyl2, L^22|'-' J 

+ I{Cu,C2i;Ci2, C22) 

— , Oil, U21, O12, 022j + -< (,-^1 , (-^11, L'12|'J j + -< 1-^2 ) ^21, (-^22|'J j 
+ /(Cii,C2i;Ci2,C22), (13) 

where (a) is true since - (Xf,Xf) - (^11,^12,^21,^22) and (b) is true since (Cii,Ci2) - Xf - 

S^-X^-{C2l,C22). 

Let Yii = Xii + Zii and Y2i = X2i + Z2i, where Zu and Z2i are i.i.d Gaussians with mean zero and 
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variance a 



1^ and (t|,^ for i G {1, 2, . . . 



n}. Also, Zii and Z2i are independent of Si, Xu and X2i. Now, 



-^(Cll, (^21; C'l2, (^22) —H{Cii,C2l) + H{Ci2,C22) — H{Cii,C2l,Ci2,C22) 



=H{Cii,C2i) + H{Ci2, C22) — H{Cii,C2i,Ci2, C22) 

- H{Cu,C2i\S^,Y^,Y^) - HiCu,C22\S^,Y,^,Y^n 

+ H{Cu, C21, C12, C22I5", , IT) + HCii,C2i;Ci2, C22\Yr, Y^, 5") 
=/(5", Fi", Y^; Cn, C21) + 1(5", y^", Y^; C12, C22) 

- /(s", y", yg"; Cii, C12, C21, C22) + -^ic*!!, C21; C12, C22|^i", ^2") •S'") 

>/(5", y^", y2"; Cn, C21) + 1(5", yi", ya"; C12, C22) 

- /(S", 1^", 1^"; Cn, C12, C21, C722). (14) 



For 1 = 1,2, 

I{S^,Y^, Y^; Cu, C21) = I{S^; Cu, C21) + I{Y{^; Ci^|5") + I{Y^; C2i\S^) 

since (y", Cn) — 5" — (y2", C2i)- By the definition of the rate distortion function for Gaussian random 
variables, 7(5"; Cn, C21) > f log g and I{Y^; CkAS"") > f log for k = l,2. Therefore, 



I{S'^, y", y2"; Cii, C12, C21, C22) —1(5"; Cii, C21, C12, C22) + I{Y{^, Y^; Cn, C21, C12, C22|5"^) 

=1(5"; Cn, C21, C12, C22) + Cn, Ci2|5") 



where in the last step we used {Y^ Cn, C12) - 5" - {Y^, C21, C22). Further, for A: = 1, 2 

/(y,";C,.i,Cfe2|5") = -h{Y,-\S^,Cki,Ck2) + h{Y,^\S^) 



I{S^,Y{^,Y,^;Cu,C2i)> -log 



A(o!iz + 4j(t^2z+4.) 



(15) 



Observe that 



+ /(y2";C21,C22|5"), 



(16) 




(17) 
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where (c) follows from entropy power inequality (EPI). From (fT4l ). ([T5] ). (fT6l ) and (fTTl ). 



2 " (di2 + 4j((i22 + 4 J (^11 + 4J(^^21 + 4J^1^2 

+ ^ log(a^^e-2*^ + 4j(^^^.e"2*^ + a|j - 1(5"; Cn, C21, Ci2, C22) 



Substituting the above in (fT3] ). we get 

1 (cr^^ + cr|^ ) (fJ^^ + cr|Jcr^ 
+ i?21 + ^12 + ^22 ^^1 + ^2 + 7: log — ; '} \ f i ' 9 ^, , ' 9 ^ ^"^ , , 2 



2 



+ ^logK.e-2*^+4jK.e-2*^+4j 

1 (7^ 

=ri(dii,di2,ti,(T| ) + r2(d2i,d22,i2,o-|j + - log „ 1, , (18) 

where the last equality is due to the definition in (fTTl) . From Lemma [2l we have p € By Lemma [3l 
AJ'p / 0. Let Ap G AJ'p. Note that rk{dki,dk2,tk,o'zJ is decreasing in d^i and (ifc2 and increasing in 
tfc for = 1, 2. This implies that 

rk{dki,dk2,tk,crlj > rk{dki + Adki,dk2 + Adfc2,tfc - Atfc,fj|j Vp G J". 

Therefore, 

i?ii + -R21 + ^12 + i?22 >n {du + Adu , di2 + Adi2 , h - Ati , al^ ) 

1 4 

2 A 1 ^5 



+ ^^2(^21 + Ad2i,d22 + Ad22,t2 - At2,azJ + - log 



2 ° i:>iZ)2 

By definition, p + Ap G V. Therefore, 



1 (7^ 

-Rii + ^21 + -R12 + ^22 > inf sup ri{du, di2, h, alj + r2{d2i,d22,t2, (Jz.^) + -log ^ 



■ 

In the following section, we show that the lower bound on the sum rate described above is achieved 
by the Gaussian scheme. 

V. Equivalence of achievable sum rate and lower bound 

Before we compare sum rate of the achievable scheme with the lower bound, we present two lemmas 
about parameters introduced in the previous section which will be used in the comparison. We will use 
the notation p = (dn, (ii2, 1^21, 1^22, ii, ^2)- 

Lemma 5. If rr + maxj^, ^| — \- > tt and p eV, then 

dki + dk2 - (T^^e-^^" -a%^<0 
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for k = l,2. 

Proof: Let p £Vi. Since 

1 1 ,11,1 1 

substituting for and from ([H), dOjl and (ITOl ) respectively, we get 

^Afi - C^Afie"2ti (i21 + d22 - (7%^ - (T%. 



dn + di2 - - <J%^e ^ dai + ^22 - - ^ 1 1 , 

4 1 4 r maxj^— , — 5— / S L). 



Therefore either dn + di2 - <7% - crjj 6"^*^ < or ^21 + ^22 - o-% - (7% e~^*^ < 0. Let du + di2 



^11 + ^12 -cr^, -(7%^e d2l + d22 - -'^N2^ 1 ^ 

4 "I" 4 ~^ 2 — 



du + di2 - (7%^ e d2i + d22 - - <7%.^e 



-2tn 



+ — — - — p — '-^ <o, 



4 ' 4 



and cr^^e < min{(iii, ^12}, it follows that ^21 + (i22 — cr'^^ — ^^n^^ — ^- Similarly, we can start 



with d2i + ^22 — <7%^ — ^^2^ — ^' ^'^'^ 

dii + di2 - (7% - a% e-2*i d2i + d22 - (7%, - c^Le"^*' 1 ^ ^ 

r + 4^ + — < 0, 

^Ni ^N2 '^N2 

to show that du + di2 — aj^^ — fT^^e"^*^ < 0. Therefore we have now shown that if p G Vi, then 
dki + dk2 - <,e-2*^ - ^2,^ < for = 1, 2. 

Now, let p G 1^2- Therefore, (j^^e~2*'= = imn{dki,dk2}, k = 1,2. Since m.a,x{dki,dk2} < f^/^^, it 
follows that 

dki + dk2 - cr%^ - ajf^e''^^" = mm{dki,dk2} + max{4i, ^2} - cr%^ - crjf^e''^^'' 

= max{dki,dk2} - 
< 0. 

Thus for all peV, dki + 42 - cr%^ - (7%^^''^^" < 0, /c = 1, 2. ■ 
We now state and prove the second lemma about the parameters. Let (dfei) 42i tk) € Tk for A; = 1, 2. 
Define 

OtkO = 2 W "fcl = 2 J "fc2 = 2 J (19) 

'^N^ - '^N^^ ^N, - dki CTn^ - dk2 

and 



"fco + ^ "fci + /3 afc2 + /? 
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We use this function to partition the space of parameters {dki, dk2,tk) G Tk- Define, 

J^ki ={{dki,dk2,tk) G J'k ■■ 9k{0) > and gk{cr%J < 0} 
J^k2 ={(4i,42,tfc) e ^fc : 9k{0) < 0} 
J^k3 ={{dki,dk2,tk) e Tk ■ 9k{cr%J > 0}. 

Lemma 6. For k = 1,2, 

Moreover, if tt + ^ maxj-^, | > t^-, 

p £V ^ (dfcl, 42, ifc) e J^kl U J'fc2, /c = 1, 2. 

Proo/; For every (4i,42,ifc) G -^fc, one of either gk{0) > and gk{cr%J < or 5(;,.(0) < or 
9k(.o-%J > is true and therefore Tj, = Fki U Tk2 U -Ffcs- 

From Lemma|5l p £V implies 4i+42— '^Ar^^e"^*'' — o-^^^ < for /c = 1, 2. However, (4i, 42, ifc) S JtoS 
implies gk{o'%J > 0. This means that 4i + 42 — ^n^^'^^'' ~ '^Nk ^- Therefore, p £ V impUes, 
{dki,dk2,tk) ^ Tk-i- Therefore, 

p eV ^ {dki,dk2,tk) G Tki ^J^k2,k = 1,2. 

■ 

In order to show that the Gaussian scheme described in Section In] achieves the lower bound on the 
sum rate, we parametrize the achievable sum rate now. Define, 



4i = Var (Xfc I Uki , S) = (20) 



42 = Var(Xfc|[/fc2, S) = "/^y^^ (21) 

2/2 2 o \ 22 2 
= -'(,-^A;,'^fcl,'^fc2|'^'j = T^iOg 2 2 2 ' ^^^-^ 



2 ^w^fci'^vy^s 



We can rewrite the last equation above as 

= 2 + 2 • (23) 

1— e 

Let p' = {d'li, d'12, c^2i, t^22, ^'1, ^2) denote the parameters achieved by the Gaussian scheme. By definition 
of {Uii, U12, U21, U22) ^U, p' ^ T . This means that the achievable parameters correspond to a Gaussian 
scheme that satisfies the distortion constraints ([5]), Q and We use the definition of functions in ([TTI) 



January 5, 2010 



DRAFT 



14 



and the parameters introduced above in the following lemma, relating them to the sum rate achievable 
by the Gaussian scheme. 

Lemma 7. For all (C/n, f/12, f/21, U22) S U and > 0, k e {1, 2}, 
/(Xi,X2; Uu,Ui2, U2i,U22) + I{Un, f/21; ^7i2, U22) 

= n {d'n, , i'l , 4 J + r2 (4i , 42 , i'2 , 4J + ^(f^ll ; f^l2 15, Yi) + I{U2i;U22\S,Y2) + - log'''' 



6162 
(24) 

^2 ^2 „2 ^4 ^4 



h (Tg a^^ a^^ a^^ a^^ 
1 _ 1 ^ J_ ^ 1 ^2 ^22 



I 2 ' 2 ' 2 4 4 ' 

^2 CJ^^ CJ^^ CJ^^ C7^^ 

= Xi + Zi a«(i I2 = -^^2 + ■^2> Zi and Z2 are independent of both Xi and X2 and Gaussian 
distributed with mean zero and variance cj|^ and respectively. 

This lemma is proved in Appendix |B] We now show that the Gaussian scheme achieves the lower 
bound on the sum rate corresponding to every point p ^V. We prove this through the following lemma. 

Lemma 8. For every p £ V, there exists an achievable p' £ T and cj^^ > 0, k = 1,2, such that 

1 

n(dll,(ii2,tl,cr|j +r2(d2i,(i22,i2,0-|j + - log- ^ 



2 °DiD 



2 



1 ^ 

n , ^2 , t[ ,alj + r2 (4i , d'22 , ^2 , '^Ij + I{Uii; Ui2\S, yi ) + /(f/21 ; C/22 1 5, 12) + - log ■ 



2 ° <525i 

Proof: The proof closely follows the discussion in Section 5 in |[T3l . Letp = (dn, (ii2, ^21, c?22, ^i, ^2) G 
V. Choosing d'^^ = dfc^ for /c = 1, 2 and / = 1, 2, from ([8]l and (|9ll, we know that 

5i = 52 = D2. (25) 

From Lemma|6j we know that {d^i, dk2,ik) G ^ki^^k2- By definition, J^fci H J^fc2 = 0- We now consider 
two cases, (4i,42,ifc) G -T^fci and (41,^2, ifc) G -7^fc2- 

A. Cas£> 1: (4i,42,ifc) G -^fci 

Since {dki,dk2,tk) £ "Pfci^ ^fclO) > and gf^{a'j^J < 0. Therefore, there exists an a*f, € (0,0"^^] that 
solves gk{ak) = 0. We set = a*j.. Further, = dki and ^2 = '^fc2 imply that o"^^^ = Ofci and 
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^Wk2 ~ "^'^2- Therefore, we conclude from (1231) and gk{a*k) ~ *-* ^^^^ ~ We now need to show that 
this choice of is such that crWki^Wk2 — (^I-)^- Since ako > and G (0, u^^], 

1 



Ofco + al>al 



Oko + a 



Since g{al) = 0, 



^ 1 

A: " 



< 



1 1 1 
< ^ 



< 



W,2 



a 



Moreover, trivially. 



,2 2 \ ^ *^2 



Also, 



(T 



2 I 2 ' 



The off diagonal entries in Cov(C/fci, C/fc2|5'i ^fc) are zero if 



1 = 1,2 



1 


1 


+ 




4 


1 


1 


1 


1 








1 


1 



2 



a 



a 



Or, 



By choosing a\ 



in this case. 



Var(C/fci|5,n)Var(C/fc2|5,n) = | Cov([/fci, f/^al^, n) 



and l(\Jk\\Vk2\S^Yk) = 0. Note that we are allowed to choose cr|^ 
this case. 



-Ik 



- since Uk € (0, air 1 in 
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B. Case 2: (4i,42,ife) G -^fc2 

In this case, we set = in (l22l ) and achieve the coiTcsponding t'^. Since, d'j^^ = d^i and d'^g = '^A:2> 
we have o"^^^ = a^i and o"^^^ = ak2- It follows from ( fT9l ) and ( |23l ) that 



1 1 1 
+ + — 



Since gk{0) < 0, this implies that 



(Tn^ Oki ak2 (T% e 2i', 



1^1 1 

11111 
+ — < — + + 

"fcO 0-^^ CTn^ "fcl "fc2 



1 111 

- 4 
1 



-2t' 



Therefore, we get that < i'^. By achieving t'j^ instead of t^, we still satisfy the central distortion 
constraint for the original problem and also ensure (c^fci, ^^^2' ^fc) ^ -^k- Further, we choose a^^ = in 
this case. Therefore 

1 

rk{dki,dk2,tk,0) = o log , = rk(.dki,dk2,t'i,,0), 
^ "fcl"fc2 

Moreover, since = and = 

/(C/fci; C/fc2|S, = /(C/fci; C/fc2|S,Xfc) = 0. 



The lemma follows from the cases considered above. ■ 
Therefore, it follows from Lemma |4] and Lemma [8] that for every p £ V, there exists an achievable 
p' £ T such that the sum rate achievable by the Gaussian scheme is equal to the lower bound on the 
sum rate. This proves the optimality of the Gaussian scheme for the sum rate of the vacationing-CEO 
problem. 

VL Conclusion 

We introduced the vacationing-CEO problem which in essence, is a CEO problem with multiple 
descriptions. We described a Gaussian achievable scheme and presented a lower bound for the sum 
rate as an optimization problem over the code parameters. We also showed that the Gaussian scheme 
is optimal in terms of sum rate for a class of distortion constraints. Future work includes extending the 
result to other distortion regimes and considering a two terminal source coding problem with multiple 
descriptions. 
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Appendix A 
Proof of Lemma [U 

In order to prove Lemma [TJ we need to show that \/6 > 0, there exist {R^^, R[2, R21, R22) ^^'^ 
{Rn, R12, R21, R22) that satisfy ([B and ^ such that 

|i?ii + R21 + R12 + R22 - I{Xi,X2; Un, U12, U21, U22) - I{Uu, U21; C/12, U22)\ < 6. 

Let e = I and (C/n, f/i2, ^^21, ^^22) S U. We choose 

R[, = I{Xr, Uu) + e R',2 = /(Xi; UuPu) + HUu, Uu) + e 

R'21 = I{X2; C/21) + e R22 = I{X2\ U22\U2i) + /(C/21; U22) + e 

= ii;i -/([/ii;[/2i) + e R2i = R'2i + e 

R12 = R12 ~ I{Ui2] U22) + £ -R22 = R22 + ^• 

Note that {R[^, R'^^, R21, R22) satisfy © and (-Rn, iii2, -R21, -R22) satisfy dill. Therefore, 

RU + R21 + i?12 + ii22 =Ru + R'l2 + ^21 + ^22 - ^(f^li; ^21) - /(f/12; ^722) + 4e 

=/(Xi; Uu, C/12) + /(f/11; C/12) + I{X2; C/21, C/22) + /(C/21; C/22) 

-/(C/ii;C/2i)-/(C/i2;C/22) + 8e 
=/(Xi, X2; C/11, C/12, C/21, C/22) + /(C/11, C/21; C/12, C/22) + '5. 
Allowing (5 ^ 0, we see that the Gaussian scheme achieves the sum rate 

inf /(Xi, X2; C/11, C/12, C/21, C/22) + /(C/11, C/21; C/12, C/22). 

(C/ll,;7l2,!721,C/22)GW 

Appendix B 
Proof of Lemma |7] 

By procedural steps, we have 

/(Xi,X2; C/11, C/21, C/12, C/22)+/(C/ii, C/21; C/12, C/22) 

= I{S; C/11, C/21, C/12, C/22) + I{Xi,X2; C/11, C/21, C/12, C/22 1 S) 

+ /(C/11, C/21; C/12, C/22) 
= I{S; C/11, C/21, C/12, C/22) + /(Xi; C/11, C/12IS) + /(X2; C/21, C/22I5) 

+ /(C/11, C/21; C/12, C/22) 
= I{S; C/11, C/21, C/12, C/22) + t'l + 4 + /(C/11, C/21; C/12, C/2: 



V22j. 
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Recall that Yi = Xi + Z\ and Y2 = X^ + where Z\ and Z2 are Gaussians with mean zero and 
variance and and independent of 5, X\ and X^. Now, 

/(f/11, t/21; f/12, C/22) =/l(f/ll, C/21) + /l(C/l2, C/22) - [/21, C/12, ^722) 

=/i(C/ii, C/21) + /i(f/i2, C/22) - h{Uii,U2i, c/12, C/22) 

- h{Uu,U21 \S, Yi,Y2) - h{Ui2, U22\S, Yi,Y2) 

+ h{Uu,U2i,Ui2, U22\S, Yi, ^2) + /(C/11, C/21; C/12, C/22II1, 1^2, 5) 
=/(5, Yi , ^2 ; C/11 , C/21 ) + n , y2 ; c/12 , C/22 ) 

- /(S, n, y2; Uu, c/12, C/21, c/22) + l{Uu;Ui2\S, Fi) + /(C/21; C/22I5, Y2). 

(26) 

For / = 1,2, let 61 = o-|e~^^('^'^"'^='). Now, we can compute mutual information expressions between 
Gaussian random variables or use the fact that Gaussian random variables satisfy Lemma 3.1 in n with 
equality to conclude that, 

1 , 1 1 _ „-2/(Xi;(7i,|S) _ p-2I{X2;U2,\S) 

_J_2I{S;Uu,U2,) _ _L , ^ ^ , ^ ^ 

2 2 ' 2 2 

_ 1 _ 1 + ^ + 1 <i 4^ 



Therefore, 



r 2 ' 2 ' 2 4 4 ' 

cj| CT^^ cj^^ cj^^ 

I{S, Yi,Y2; Uii, U21) = I{S; Uu, U21) + I{Yr, Uii\S) + I(Y2; U2i\S) 
2 °^ Siid[^ + al){d',,+al 



log "^'^"^vi ' "^i^v"iV2 ' "Z2^ ^27) 



Observe that 

I{S, Yi,Y2; C/11, C/12, C/21, C/22) = C/11, C/21, C/12, C/22) + /(n, I2; C/11, C/21, C/12, C/22I5) 

= 1(5; C/11 , C/21 , C/12 , C/22 ) + /(n ; C/11 , C/12 1 5) + 7(^2 ; C/21 , C/22 1 S) , 

(28) 

and for k = 1,2 



I{Yk;Uui,Uk2\S) = -hiYk\S,Uki,Uk2) + hiYk\S) 

log(e^'^(^'=l^'^"'^''^) + e^^^^")) + h{Yk\S) 



2 

= -i log(ai,,e-2*'^ + 4J + ^ ^og{al^ + 4j, (29) 
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where (a) follows from EPI for Gaussians. From ([27]), (EH) and (|29l ). 

1 (air +al)(a% +a%)ai 



2 {d'i2 + 4J(42 + 4.)('^ii + 4i)('^21 + 4.)'^i'^2 
+ i logK^e-2*i + a|j(a^^e-2*^ + 4 J " ^(5; t/ii, ^^21, Uu, U22) 

+ I{Uu; Ui2\S, Yi) + /(C/21; [/22IS, ^2) 

and 

/(Xi,X2; C/11, C/12, f/21, f/22) + I{Uii, f/21; f/12, C/22) 

= n , ^'12 , t[ ,alj + r2 (4i , d'22 , i'2 , '^IJ + ^(f^ii ; ^12 15, Yi)+I{U2i-,U22\S,Y2) + - log ^ . 
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